Commentary: Reporting standards are needed for evaluations of risk reclassification.
نویسندگان
چکیده
New approaches have been developed in recent years to quantify the improvement in prediction performance gained by adding a novel marker to a set of baseline predictors of risk. The paper by Tzoulaki et al. concerns risk reclassification techniques and focuses specifically on the net reclassification improvement (NRI) index. Their review shows that use of risk reclassification analysis is extremely common in practice, with 51 papers using the technique published in only 3 years since its introduction. Unfortunately and alarmingly, the review shows that the quality of reporting is dismal. Investigators seem confused about the roles and interpretations of risk reclassification metrics. Guidance on how to report results of risk reclassification analysis would be helpful to authors, reviewers and the field in general. The risk reclassification table was first introduced by Cook. The table is constructed by choosing clinically meaningful risk categories and cross-classifying individuals according to their risks calculated with the baseline risk model and with the expanded risk model. The top panel of Table 1 provides an illustration. Cook and Ridker developed a whole analysis strategy around the risk reclassification table including new hypothesis tests and a new metric called ‘percent correct reclassification’. However, the value of these analysis techniques is doubtful and results can be misleading. Pencina et al. argued that the reclassification table itself was problematic, at least as proposed by Cook, because it did not distinguish between subjects with events (cases) and subjects without events (controls). They suggested constructing separate event and non-event reclassification tables as shown in the middle and bottom panels of Table 1. Entries above the diagonal correspond to risks that are higher with the expanded vs baseline model, representing improved prediction for subjects with events. Correspondingly, entries below the diagonal represent worse prediction for them. The event-NRI is the difference between the proportions of subjects above vs below the diagonal in the event reclassification table. Using a similar logic, the non-event-NRI is calculated from the non-event reclassification table by taking the difference between the proportions of subjects below vs above the diagonal. The NRI summary index that gained immediate popularity in the literature following Pencina’s paper is the sum,
منابع مشابه
domestic and international regulations and standards for risk disclosure in banks
Reporting by stakeholder groups, especially shareholders, has always been a demand And reporting and disclosure for the banking network is important. In Iran, banks require disclosing and reporting information and financial and economic events, but there are many international rules and standards for this disclosure. In addition, domestic regulations and requirements are also unclear due to the...
متن کاملRAMESES II reporting standards for realist evaluations
BACKGROUND Realist evaluation is increasingly used in health services and other fields of research and evaluation. No previous standards exist for reporting realist evaluations. This standard was developed as part of the RAMESES II project. The project's aim is to produce initial reporting standards for realist evaluations. METHODS We purposively recruited a maximum variety sample of an inter...
متن کاملImproving the Quality of Diagnostic Studies Evaluating Point of Care Tests for Acute HIV Infections: Problems and Recommendations
The diagnosis of acute human immunodeficiency virus (HIV) infection (AHI) plays a unique role in preventing the spread of HIV and ending the epidemic. Acutely infected individuals are thought to contribute substantially to forward transmissions of HIV; however, diagnosing AHI in resource-limited settings has proven to be a challenge. While fourth generation antigen-antibody combination assays h...
متن کاملPrognostic value of positron emission tomography myocardial perfusion imaging beyond traditional cardiovascular risk factors: Systematic review and meta-analysis
BACKGROUND Despite substantive growth in utilization of positron emission tomography (PET) myocardial perfusion imaging (MPI), evidence on its prognostic value is limited. We aimed to comprehensively evaluate the prognostic literature of PET perfusion measures according to the most recent American Heart Association recommendations for assessment of novel cardiovascular biomarkers. METHODS We ...
متن کاملProblems with risk reclassification methods for evaluating prediction models.
For comparing the performance of a baseline risk prediction model with one that includes an additional predictor, a risk reclassification analysis strategy has been proposed. The first step is to cross-classify risks calculated according to the 2 models for all study subjects. Summary measures including the percentage of reclassification and the percentage of correct reclassification are calcul...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- International journal of epidemiology
دوره 40 4 شماره
صفحات -
تاریخ انتشار 2011